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This note will tSlscues In detail certain aspects of a 
videotape edltln® console with a computer nerve center, 
deslcrned to speed up videotape edltlno* and enrich the 
editor's options. The creneral deslcrn was discussed In an 
earlier note, "A Sophisticated System for Videotape (and 
Motion Picture) Editing." In part this Is an expansion 
of Ideas presented before the Society of Motion Picture 
and Television Engineers In 1965, to be published In a 
larorer version In the J.8MPTE later this year. 

However, other contents are proprietary, and are here 
presented In confidence. Certain Ideas In this paper may 
be patentable, and their enclosure In this proposal does 
not constitute their publication or relinquishment. 
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INTRODUCTION 

It l8 now poaelble^/o put a computer at the nerve center of 
videotape edltlncr, and therefore film edltlner as well. The 
detaila of 8wltchlo<y and controlllni^ tapea may be concentrated 
and consolidated In the computer, slmpllfylncr the editor's 
Job. Individual shots will be automatically assembled Into 
consecutive sequences, under the editor's direction. In 
addition, new services may be deslirned and prorrrammed Into 
the system, to simplify boolckeeplnt», render comparisons more 
convenient, and clarify decisions. 

This Is not the basic proposal, but an extension of It. 

The reader who wants a clear Idea of the way the system Is to 
behave should w »o to the section called "System Behavior and 
Services" parre 

In this paper various details of such a system will be 
explained. These Include l) the control Interface amoner the 
component units, 2} possible details of some operations, 

3) ■ the form of storacre and flllnjr, and 4) t specific procedures 
that xlxMr may be employed in shot rearrano’ement. In addition, 
there will be clarlficatlonf of possible services the system 
can perform, includlno^ such techniques as epeclfylo^ shot 
assembly by wr*ltten descriptions. 

This paper describes a hlt^h-capablllty system, without 
shortcuts. Lesser systems are of course possible, and would be 
easier to implement. But In the loner haul the system described 
here will be the Important one, and it mlo'bt as well be b8«r’un 






DOW 88 later. 
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There are three quest Iona the reader la lilcely to have 
about the ayateni described In this paper. First, can It be 
4one at all? Second, la this luethod appropriate? And third, 
what Is the exact uaefulnese of the aervlcea proposed here? 

The answer to the flrat iLay surprise people, but Is 
Btr8l«»’htforward, an unqualified yes. 

The second question, the appropriateness of the computer 
methods described-- especially the file methodsjj-- Is arc'uable 
BtDonP’ experts. It depends In part on the extent to which 
text handllner should be a part of the system. It Is my 
personal belief that without text handllner the system can do 
nothlnf? slernlflcant, except speed up what Is done already. 

It la on the thld question that the potential user 
may hesitate. 

Of course, new ^ and unaccustomed procedures are Involved, 
and some of these may cause objections. One of the unusual 
features of this sytem Is the use of text labels for commatndlntr 
new shot sequences. Somebody has crot to type these In. 

A few people I’ve taliced to think typlno- le worse than spllclner. 

But even If this Is true, ways can be found of tylnjr a secretary 
Into the system. (Note* that there le presently no way to 
ero from dictation to computer^Input ^ 

But users will not » be always held to particular* services 
that one**** person has dreamed up. These services are open - ended . 
They may be redesigned and chan<red at any time as better ones 
become apparent. This system can evolve and arrow as we think of 


new 8e3rvlce8. 
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It should be eaiphsslzed that the user actions will be ex— 
treaely quick and easy. Otherwise the eystetu would be too much 

trouble. 

A computer-based system shhuld always simplify and clarify 
human activity, ttaklo<T work easier and quicker. The popular 
lma<re Is unfortunately the opposite; that computers are extreirely 
"difficult” and always "numerical." Neither of these Is true. 

The system to be described here Is Intended to simplify and 
clarify. The user need never see a number unless he wants to 

use them. 

Special pushbuttons, etc., will of course be needed. But 
these will not be discussed here. The reader must assume that 
when It says here, "the editor may do such-and-such," that a 
fairly convenient means can be provided for him to do It. 

But the exact layout of pushbuttons, etc.^would evolve alon^ with 

the system. 

Other details to be omitted here Include mass memory 
and other computer details. There will be some discussion of 
the swltchln'^ hardware and* procedures. But these, too, are 
X shallow aspects of what has to be done. The problem la to 
provide comprehensive services Involvlop text sod alternatives. 
(If mere switching were the only problem,a ten-thousand-dollar 
computer could handle It •) 

Kuch computer procrammlns' Is necessary to make a basic 
system work. But as soon as a system exists which Is better 
than t present methods. Improvements can be made at leisure. 

The user services are built on top and easily chao'^eiable, like 


the superstructure of a ship. 
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This paper Is Intended merely to state In detailed outline uxrwt 
a set of technl^quea and services that will tnaice such a system 
worth berlnnlnfff and persuade the reader that the system Is 
currently possible. 
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conkections 

Althou<^h conputer control of vldcotspc recorders end 
ewltchlnn- le a new application, coaiputer control of thln^rs 
In !^eneral le an old problem with old aolutlons. Control 
slcrndls out from the computer, and feedback sl^Tnale back 
from equipment to the computer, ere a conventional matter. 

The main Input-output taska need In this aytem are 
l) exact control of videotape recorders (VTRs), 2) control 
of a swltchlntr network, end 3) text display. The mechanics 
of the text display will not be discussed here, since It le 

a standard computer application. 

The dlcrltal Interface Is fairly straIarhtforward , althou^rh 
there are certain choices to be made (exterior eratln^ vs. 
holdln;^ reo'leters, etc.) 

Command code patterns would be sent out by the computer 
and be decoded so as to reach Individual units as effective 
electrical slornale. The decodlo<^ system le usual^ available 
from the computer manufacturer? specific connections to 
external circuitry must be established by the customer 
(or. In this case, the videotape enerlneer). 
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VTR Hoolnap 


Computers can control vldootsp® recor'lors (VTRs). The 
ex8Ct connections to be OiSde to KS VTRs will flepenl on the 
technical details of the VTRe employed, and the relative 
simplicity and cost of particular connections. 

Presumably the basic functions of the VTR are under 
electronic and/or solenoid control from the computer. These 
Include Play, Record, and Rewind. They may also Include Fast 
Forward, Rark (eslBtabllshlnc^ an edit marlcer on an edltln?^ track 
of the tape). Step (move forward one frame), and Backstep 
(move backward one frame). Slow Forward, Slow Back and 
Transfer In Reverse (between VTRs runnln' backward) would be 
particularly helpful for this application, but may be too difficult. 
It would also be beneficial to be able to chancre from Play to 
Record t without stopping, and vice versa, and to ro from 
normal speed to fast without stopplntr, and vice versa. 


Presumribly no VTR with all these faculties exists now. 
Whether It Is worthwhile to have some of these faculties 
engineered, and which of them, will require detailed study. 
StscL X i, Improveicsnt8 each would off6r shoulil lo^lcatet for 
each of these capacities, whether It Is worth crestln*^. 

(But as an example, I would Tuess that addins Transfer In 
Reverse would be as erood as doubllntr the number of B VTRs In 


the system.) 
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Swltchln*^ Hookup 

A lar<ye number of switching connect lone muet to subject 
to eeparste control by the computer. Different s eUnele by the 
computer must be able to connect specific video outputs with 
;^peclflc video inputs. In addition to the swltchlncf, the 
computer should be able to manstre fades, dissolves and possibly 
mattes. For this reason controllable attenuators at the video 
Inputs or outputs mlo-ht also be wanted. 

Similarly for audio. A complete audio ewltchlns^ system 
must be under computer control. Each VTR must be connectable 
by the computer to specific audio lines, and there must be 
a complete set of volume controls also under computer control. 

Continual raaat of audio pots must be possible, for fully 
automatic control of the sound mix. 

Equivalent swltcbln"’ procedures con be used for swltchlncf 

monitors and speakers. 

As It happens, video swltchlncf equipment which Is dlcrltally 
controllable la a catalog Item from at least two firms (Whistler, 
Trompeter). The only questions are a) how to arrancfe the digital 
Interface, and b) how to arrancre the switches. The dUltal 
Interface problem has already been mentioned. It Is a deslern/cost 
probl6i2^t 3oee not r6Qulre our attention here. 
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>iatrlx V8. TniniB 

Another technical Ipeue concerns the relative sdvantacres 
of different ewltchlno^ methods. One method would be to have 
a complete swltchln«r matrix with cropspolnts between all Inputs 

and out puls. 


VTR 3 »« 


VTR 


VTR 4 

VTR 5 
VTR 6 


INPUTS 
1 2 3 4 5 6 


-1 




H 


—^ 

_ 







_ 







/ 







\ 







_X 
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A simpler arran®'ement would switch all Inputs and outputs to xw2t 
and from trunk lines. (However, probably at least two trunks 
would be wanted, to yrexwwtxMt* permit setups In advance and 
simultaneous vlewlno’ of more than ■» one monitor. If desired.) 

OUTPUTS INPUTS 



The relative adv8nt8<^0 of the trunk method Increases with the 
number of VTRs, as can be seen from the number of video 
pwltchlncr connections required by the two methods. 


of VTRs 

Matrix 

A & B trunks 

(Input 4 output from 
each machine 
to each trunk) 

2 

4 

8 

4 

16 

16 

6 X 

36 

24 

8 

i 64 


10 

' 100 

40 
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However, s counter-argument for the ewltchlo'r matrix 
18 that a full BwltchlOT matrix will permit uoreatrlcted simul¬ 
taneous copyln*'^ amone^ VTRs* The trunk method would require 
one ti^nk for each possible simultaneous transfer. If there 
were four trunks, no more than four transfers could taka place 
simultaneously; and one of these trunks would be required for 
each monitor channel used, fk removlnc^ them from participation 
In transfers. 
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VTR Statue Slf^nals, Tlmlno* eni Feedback 

Signals frouj the VTR to the onmputer will aleo be required. 

The selection of the moat simple, practical or efficient 
alernals will require detailed etudy. 

One Important claee of elo-nal would tell the computer the 
present activity of th» a VTR, so that Its status could be 
checked. These could be pulses or volta-re levels Indicating 
the current motion (forward or back, fast or slow) and state 
(play, record. Idle). A "frame'’ pulse, iodlcatlniy the passacre 
of a complete frame. Is probably desirableJ this could be 
crated by the flyback or blankln^* 8l«rnals of the video. However, 

It should be Independent of whether the VTR Is trolncr forward or 
backward, fast, slow or at normal speed. Perhaps there should 
aleo be a way for VTR to Indicate that It has reached a 

destination— be'rlnnlne of tape, end of tape, or edit mark. 

(These mlcrht all be combined Into a "completion" signal.) 

A number of possible methods mlcrht be used for the tlmln^ 
of shots. It ml-Tht seem obvious to use edit markers of the 
Edltec type, as Is done now. But this may not be as crood an 
Idea as It seems at first. The computer can by other means 
address to any frame, so that Edltec marks are not essential. 
Koreover, when the exact berlnnincr and end of a shot are not 
exactly decided, the Edltec marks Is no particular 

help; the computer can address the alternatives separately. 

A variant scheme would distribute edit marks at recruler tstsxxxl 
Intervals evenly throucrhout the videotape, and merely transmit 
special 8lo>nal8 to the computer as they <^0 by, Instead of stopplncr. 
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ThlB wouia mean that frame-by-frame countin'^ would have to 
proceed for only abort dletancea. 

A third poaelblllty la to use a cue track for complete 
addressee In dl^rltal format. The cue track used for Bdltec 
could probably be put to better uee as an address track, IWBtvxB 
holdlno' the absolute address of every paealn*? frame (as in 
Matsuoka's system). This would save a lot of countlncr of 
frame pulses: the computer could always ascertain the absolute 
position of the movin'^ videotape. It rnlo^ht also allow the 
computer to find out easily where a VTR has erotten to in a 
rewind or fast forward, without bothering to count every 
passlno' frame. 

A full address track would be particularly advantageous 
If an address rae^ister could be Installed on the VTR, so that 
the computer would not have to be continually Interrupted to 
keep track of the proTress of the different machines. This 
Interrupt scheduling Is the most difficult part of the whole 
system, and such an oTternal search feature would be a crreat 
advantage. 

How to use frame counts, edit marks and addres8ln<y depends 
on various statistical questions of count sizes and Interrupt 
overhead. It also texts depends » on stopping speed and 
Btopplnv speed and accuracy of the recorder. If tlcl there Is 
a danger of mlsslno- an occasional frame pulse because of the 
Inertia of the recorder, such precautions as addresslo'T become 
very Important . 
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BASIC OPERATIONS 


Larn-d computer procrrama are made up of smaller ones. 

Thus, to explain how to do a larcre Job with a computer, 

It should be sufficient to explain how to do each small Job 
of which the larere one Is composed. Then every time that 
part of the Job needs to be done, the computer eroes through 
that short program a^aln. 

It Is the Job of the computer profrrammer to lay out these 
tasks In advance, In threat detail, so that they are waitin'? tw 
ready for the user, who needs to know not hi n*? about how they 
work. 

So far we have dlscuesed electrical connections that 
will 'rive the computer complete control of VTRs and tl^lr 
Interconnectlone. 

To the computer programmer, however, this assortment of 
hardware and attachments xr« Is all alike? they are '‘devices 
to be Incorporated Into the prorram throu<rh specific commands. 
By wrltlnff an Instruction such as 

#3 00 forward 

he can provide ahead for the occasions on which the computer 
must start VTR #3 polncr forward. By writing? an Instruction 
such as 


#2 BACKSPACE Y FRAI-JIS 

he can provide ahead for the occasions that the computer 
will send VTR #2 backward a number of frames that will be 







15 


specified later. 

Naturally, It ia not tbeee words that tnvwtvs make thln^a 
happen, but their coded equlvsleote, translated Into electrical 
pulse-patterns. The words, thouf^h, can provide a convenient 
and ■* exact way to list and plan the thing’s that need to be 
done. 

Here, In a similar form, la a short protrram. The computer 
should be able to send out coded tequlvalents of this proerram 
to Bccompllsh an orfranlzed purpose. 


CONNECT VTR 1 VIDEO OUTPUT TO LINE A 
CONNECT VTR 4 VIDEO INPUT TO LINE A 
CONNECT VTR 1 AUDIO OUTPUT TO LINE C 
CSXXEK 

SET VTR 1 AUDIO X OUTPUT TO HALF 
CONNECT VTR 2 AUDIO OUTPUT TO LINE C 
SET VTR 2 AUDIO OUTPUT TO 3/4 
CONNECT VTR 4 AUDIO INPUT TO LINE C 
START VTR 1 PLAYINO 
START VTR 2 PLAYING 
START VTR 4 RECORDING 


It will be seen that this set of commands malces connections 
that will, when the machines are started appropriately, perform 
a video transfer from 1 to 4 and an audio mix from 1 end 2 to 4. 
(That Is, the startin'^ settlnsrs for the mix.) 

Andj^ naturally, such commands as 


CONNECT i^MTOR N TO LINE A 
CONNECT speaker TO LINE C 


may then be used to see and hear what Is belncr recorded In the 
previous hoolcup. 
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Lersrer Comblnat lone of Operations 

I'he object now will be to deuiOnetrate how aaall taelte, 
like those described above, can be oouiblned Into complete 
and useful actions. We will look at some aUnlflcant Jobe, 
easentlal to an edltlno- setup, and the way they are built up 
of aaialler sections. (The reader must accept on faith that 
each Instruct loo listed here can In turn be built up from 
the basic operations the computer will have available.) 

The procedures described are not neceesarlly the most efficient? 
they are Intended to explain. 

1. HOW TO COPY FRO>i ONE VTR TO ANOTHER. 

Connect VTRe appropriately to same line 
01 ve PLAY and IS STArtT command a to source VTR 
Give RECORD and START commands to tarf^-et VTR 
Beffln couotlnT frames; each time a frame pulse arrives. 
Interrupt current proo-ram and subtract one 
frooi the left to 

When the number of frames left to vo reaches zero, stop. 
(Aimlternatlvely J set timin'^ retJ’lster and compare It 

repeatedly with * 60-cycle click, till It matches 
or exceeds time shown st clock.) 

The followin'^ methods uae lists of shots and sequence, 

(Stor8^>^e methods are described later In 


stored on a dlak file, 
this paper.) 
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2. SORTIINO METUOD. 

(This pronran. of actions tranefera a series of shots from 
VTR 1 to VTR 2, putt loo* them In a new .leslred sequence.) 

Create list of shots to be transferre'a C’esaembly list ) 

In order 

Ascertain length of whole sequence by addlnor up len<?the 
of couiponent shots on assembly list 
Move VTR 2 to be^lnnln^ of blanlc tape 

Malce sure length of whole sequence Is not srreater than 
available blank tape on VTR 2 
Got to very beTlnnlnif of eeseitbly list 

__^sscertaln "nert** shot on assembly list 

Fast forward or backspace on VTR 1 to becrlnnlnT of 
that shot 

Transfer that shot, recorllnff from 1 to 2 
Test whether all shots on assembly list have been 
transferred 

--— If not repeat proorram loop 

If so, stop 

3. PROCEDURE FOR FINDING A SHOT ON VIDEOTAPE. 

(This assumes that the shot Is stored somewhere on VTR <^5.) 
Look down the list of shots now stored* on VTR 5# 

testlna- whether each Is the desired shot number 
When and If that shot number Is found, ascertain Its address 
on the tape 

Subtract the current position from that addrere 
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Oo forward or back the reeultlnir number of framee, 

the direction depending on whether the result Is 
pmoBltlve or negative. 

Example « Suppose the shot you want beslns at frame 900 

The VTR Is currently positioned at frame 1450. 

Desired position 900 
KlnuecBurrent position 1-1450 

- 550 

The VTR is then backspaced 550 frames. 

AS has been stated, these have been examples for explication 
and leave out Important procrrammlnp' techniques. Koreover, 
the methtods used for sorting and ellocetlnir tasks and apace 
amonff VTRs will need considerable analysis and Improvement. 

This falls within the realm of “opt Imlzlncr and Is not relevant 


to this paper. 
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HOW KANl RECORDEftS? 


An Important question Is how many VTRs to use In such a setup. 
The more, the merrier; but they cost a lot of money. The system 
could really not do very much with fewer than three; but one feels 
Instinctively that over five would be ertravaeant. 

However, havlnr many VTRs will maica possible "overleaved” 
transfer: while the editor Is loolclncr at one thln<T, the computer 
can be settln^r up somethin'^ else entirely on machines not currently 
Involved. AS a .ruess, I would say that six VTRs would permit 
the editor to view almost continuously when be Is not plcUlOff 
or typlno-. 

It mlffht be that three or more top-quality VTRs would bo 
usetd for the masters and the final copies, but economy* models 
with less fidelity could hold parte of t* Intermediate assemblies. 

The problem of how many VTRs Is easily settmled from the 
point of view of computer software: the computer pror^ram must be 
able to function similarly retrardless of how many VTRs are 


available durlncr a o-lven session. 
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INFORi'iAaiON STORAGE 

The preceiJlno^ notes have Bho¥n the way that particular 
operations of the ayateiu may be carried out. step by step. 

A more fundameotal probletn, however, la oreranlzln^* the 
overall tasU to be performed, and handllnor the Information— 
oumbere, text and reliatlons— that locate and deecrlbe the 

Bhote stored within the system. 

These things are complicated. Not only that, but they 
represent a chanere In the way computers are to be handled; 
an openlo<r up of the machine to more Irregular Hinds of 
Information, rather than reducin'' the Information to the 
structures that machines e ordinarily handle. 

Since 1960 I have been worHlnw on the problem of how to 
store Information of this kind, the anootatlorr and catalo-ruln'r 
of Irreffular materials with texts of lrre<Tular length. 

This work bos been a development of the list processing'* 
and "pointer" techniques developed by computermen In the last 
few years. These techniques allow stored data to refer to 
other data In a (rrossly Irreerular fashion. 

The result of my work Is a type of data structure which 
I now call POIGNANT, capable of handlin'' all this Information 
and more. (The structure Is presently belnp* Implemented for 
the IBh 560 at Brown University, under my direction.) Specific 
programs need to be created for unpackin'' and uslni^ the data, 
but that Is much lees of a problem now that the basic structure 


Is well defined. 
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POIGNANT data may come In unite of any lenr^th, and be 
Interconnected any number of times. In any number of waye. 

The POIGNANT structure holds data In "tralne" of standard¬ 
sized blocks, with extra Information about the data etored 
separately (" Inpointers'*) and connectors to further data 
elsewhere In still a thlrJ packefre ("outpolntare**). 




POIGNANT "TRAIN** 

(Kany technicalities omitted) 


other trains 

Various kinds of data and meta-data are defined In these 
terms and Interconnected to any dep-ree, as sucro-ested by the 
followlnflr Illustration, suer'^estlnff relational connections 
amontr data packacree. 
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We may conal'^ler this aa a new oietho^ of etorlofl^ data havln*^ 
any form whatsoever. 

In the videotape system described In this proposali a larc^e 
problem Is the chen»ln«T data, which can aeaume very complex 
forms and structures. The chan'^ln*?’ lists of the contents of 
each VTR, and most difficult, the storage of names and descrip¬ 
tions of shots, can be stored and continually revised In this 
datax structure and Its eervlclo«r proo-rams. 

While the details of this storae^e are not crucial here, 
a few Illustrations will Indicate approximately the way these 
compound structures will be held. 

The list of shot contents: 






















The script an5 its interconnections: 



(Data) 


(Inpointers) 


(Out pointers) 


Revisions of the above materials that have not yet 
been spliced into the main lists: 



TSXT ADDITIONS 
& CHANdES 


BOUNDARIES 
OF TEXT 


WHERE ADDITIONS 
00 


(Data) 


(Inpointers) 


(Outpointers) 


Cats'Tories amono- which material is to be cross-indexed 



LIST OF 
CATEGORIES 
AND 

EXPLANATIONS 

Varletions 
permittinsy 
alternate 
displsy 


Locations of 
items fallino' 
within 
categories 


(Data) 


(Inpointers) 


(Outpointers) 
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LISTS 


Kaoy different kinds of llets of Infontstloo must be stored 
In the sjisteoi, to keep track of shots on tape and other Information. 
POIGKANT makes It possible for these llets to be Irregular end 
complicated. 

Hlffh-speed core uiemory of the computer Is quite limited 
In size. For this reason It Is necessary to store lon<r lists on 
larger memories which are* outside the computer proper. In par- 
tlcular, disk files ore most often used for this purpose. 

In this system, then, lists of shots and text would be 
principally be kept on a larc^e disk file, or on magnetic tape. 

Some llets would be stored In an ordinary fashion, some In POIGNANT. 
Those lleta will have to be Interconnected and e stored In ways 
I won't bs'^ln to describe. (These may not necessarily all be 
separate, but mlP-ht be combined In certain ways for convenience.) 

1. ORIGINAL ShOT LUST 

This llet alves the orlirlnal shot numbers and the addresses 
of their bei'^lnnlnt^s on the source videotapes. 


R'h.ei. nUPiBEK Current VTR No. 


1 

BEGINNING ADDRESS 


2 

BEGINNING ADDRESS 

•XX 

o 

• 


ShOT NO. 

BEHINNING ADDRESS 

SHOT NO. 

BEGINNING ADDRESS 
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2. CUTTING-POINT '-IgT 

This one tells the cuttIncr-polnts, or euttInflr-polnt ran-Tes, 
which the editor Is conslderln*^ for each shot. There are 
eeverel eltuatloos, of which at least £*eF*r should be recoarnlzed 

within this pytem. 

a. exactly defined shot 

b. alternative outt Ins-points 

c. cut 11 n't-point raniyeg 

We will call these three possibilities out txC®s» s^d mark them 
accord In"'ly • Different edltlnir procedures will treat them 
SltX«¥W 15 TXyx roaay (see '’Oeer aervlceax” ) • 


OUTTINO-m] 

POINT NO. 

ous- 

Clfftx 

TYPE 

START OR 
FINISH? 

_———— V 

LOCATION 

OR RANOE 

% 














3. LIST OF DiiRlVATIVi SHOTS. 

These ere derived, of course, from the different cut11no-points. 



ORIGINAL 
SHOT NO. 

NEW 

SHOT NO. 

CUTTING 

START 

1 POINTS: 
FINISH 
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4. KX CURRENT NiASTER CUOT LIST. 

Thle one telle the location of every shot the editor la 

Interested In, on each VTR. 


3hGT NO. 


dtN— I 

tttfDU^UDC ADDRESSES: 
bRATIOiiVTR Ki 

1 '-= 


FIRST FRAf’iE I LAST TRAhE 





_)(Copy 1 
_l(Copy 2 




5. CURRENT DlRiuCTORY OF EACH VTR 


VTR NO. 1: 

SHIT NO. 1 

STARTING 

FRA^i£ 

tm 


27? 

1 

i 

• 

• 


• 

• 

• 

• 

i 


RW£N£*!iri,-i* i TLXi‘y^'‘9SVCWa#lH 

6. SH-T CONTENTS LIST 

This contains shot titles, descriptions and comnients. 
Including alternative and abbreviated descriptions or captions. 


SHOT NO* 


SHOT NO. 

__J-.___1 

SHOT NO- 

_ L 

SHOT NO. 

1 ... 

SHOT MQ. 

J -, 

SHOT NO. 

1 -, 

THOT KO. 



t -- 


(Chan'^es In the contents lists may be made at any tliue.) 
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7. 


SHOT CATEGORY LIFT (elmpllflea) 


SHOT 

SHOT 

SHOT 

SHOT 

SECT 

SHOT 

SutT 



Cross-In^eyln^ uoaer all theps cats'^orles Ip posslbls* 
"System Behavior sna Fervlces.") 


(See 
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8. SCRIPT LIST 

The script list, If any, states where In the script shots tro 
(If/the editor cares to bother). Types of in hereg t ^ncertalp . t x 
■y observed . If a shot mlcTht tro In several different places, 

or contains events In other than their proper script orier, 

"script po»lnter codes"* jcsy be developed which correctly 
represent this. (This will permit the editor to request, for 
Instance, all the shots that "could" «70 In a certain place— 
accordlniT to his own previous Judt^ment.) 

The followlncr Illustration shows the ways In whlchfc shot 
Information can be made to correspond to the script In a list 
of this type. (Detail can be down to the Indlvldtual word 

In a script, but presumably that will rarely be needed.) 


SHB: 

You're a creep. 

he; 

You're another. 

she: 

Ah, your fatherl's mustache. 

us: 

Same to you. 

SHii.: 


Shot no.i 

r 

3bot no. i 

code 


OodeAl 


anox no.I 
Code r 1 



Think you're so clever. 
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(In the case of the thlH shot, the director had the actor 
spealt both llnee In the saoie shot, but with no pause, so a cut 
would have to be » made. That Is what "Code B" means. The 
fourth shot, which snows her reaction, could be used In git ,her 
location but not both. That Is what "Code C" means.) 

9 . OVERLAP LIST. 

(This list would Indicate whet shots overlap accor#dlnor 
toe the script list.) 

10. ASSEMBLY LISTS (LISTS OF SHOTS TO BE ASBEi»iBLED) 

11. LISTS OF SHOT SEQUENCES FINISHED AND NA^iED. 


These basic lists would constitute the basic data € of the 
system. They would be added to and chan-red as the editor 
added and ch 8 n<Ted Information and the contents of different 
VTRs chencred . 

These are the basic lists required for shot-by-shot assembly. 
(It will presently be explained how sequences of shots p may be 
assembled.) 

Any number of additional facilities can be construtted 
uslncT these lists. What they should be, however. Is exrremely 
hard to predict before the basic system Is constructed. Users 
will have to say what they want after experience* with U 
the basic system. As more and better user functions are requested. 


however, more lists may need to be added, .zti 


, uirsmril 








However, examplee can be fflven of oodes of work that should 
be useful, and be<Tln to show the power of such e ejreteai. These 
modes of worn are well-defined and can be built Into a basic 
sjrsteic luimed lately. 
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SYSISA BEHAVIOR AND SERVICES 


The purpose of tbla Byetem Ib to speed up, elmpllfy, 
clarify and enhance all the operations of videotape edltlncr, 
without Introduclnc^ any restrlctlona or distractions. All the 
detailed manipulations are to be performed by the computer 
accord loff to an svolvlnt^ list, Inside It, of the shotsew and 
sequences the editor Is Interested In. 

The treneral sequence of operations Is as follows. The 
editor views the orlcrlnal videotape and types names and comments 
Into a keyboard (or dictates them to a secretary, who types 
them In). By punching buttons at the start and stop of the ** 
shots that Interest him, the editor Informs the computer where 
the shots are that are to have these names and comments attached. 

The editor may now call to the screen these names, and 
point at the ones be wants combined Into sequences. As he points 
at these names with a special device, they appear In a new list 
on the screen. He may move these names around till the* sequence 

seems rl'i’ht. 

The sequences are now prepared rapidly and automatically 
eccordlo'T to the lists he has and they are soon ready 

for vlewlno-. He may continually revise the lists (and ii make 
variations of them), and have the computer show him the resultlno^ 
sequences quickly. And he may work over the details of splices 
sod cutt ln<7-polnta carefully until he Is done. 

That Is the basic system: view . stBiv select . trim and 
reconsider . Repeat In any order until done. 
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If neceeeery, the editor oiay ask for a eeoond-'reneratIon 
final copy. The computer will then arran-e to copy every 
shot from the orl<ylnal tape. 

In whfat follows we will dlacuea details of some of these 
services. However, It should be reiuembered that many other 
services are possible within a system of this kind, and these 

services are only a be^^lnnlncf. 

The appearance of the words on the screen, and the way 
they will move, depends on the form of text display chosen. 

The better systems offer lower case letters as well as capitals, 
and will permit phrases to move slowly, ae well as simply Jump. 
This capacity Is preferable, so the editor can always see 
exactly what he la dolne^. 
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ControlllQcr Shot Resrran'reoient 

This eectlon will describe In more detail the service of 
shot rearren'^exent by title or description. 

The Interior means by which the sortlno' of phrases causes 
the Bortlno^ of video will not be discussed In detail here. 
Essentially, when a shot description Is chosen, the computer 
examines Its number, IooIes t up its BsaBk number In the shot 
address table, spaces appropriate VTRs forward and baolc, and 
transfers the shot accordincrly. The details are black m marie 
(prorrammlnr). 

"Pointing" to sepect words on the screen would probably 
not be with the usual llrbt pen, which ordinarily does t not 
work with a TV screen, but rather an Enrelbart Mouse, xli 
which Is a small box on wheels which you roll around the 
desktop. This instrument Is one of the simplest and cheapest 
polntlnr devices, and Is easy to Install. 

One possible arrangement would divide the screen Into two 
vertical sections. The left eectlon could look Into a t list 
of the shots. K Although only part of the list could k 
be seen at any riven moment, the user would have a throttle 
permlttlnr him to ''scroll" up or down the list. The list 
would then move backward or forward on the screen like a 
drum tltler, with new Items appearlnr at the bottom edre 
as the old ones disappeared at the top-- or vice versa. 
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»K«XKIKI 
Shot DeBjCriptlonir 


List 


Assembly List 



V 
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The obvious alternstlve Is to iJlvlfle the screen vertically* 



Shot Description List 
(un.^er throttle control) 


Assembly List 
(similar control) 


The other half of the screen would hold the evolving 
assembly list. The editor would point* at the Item he wants 
in the tt»t shot description list, it would bllnic ecknowledament 
(so he could maice sure he * had pointed correctly), and then he 
would point at the place he wanted that shot Inserted on the 

In a flash that Item would be added to b 


assembly list. 
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the aeeeably Hat; ao<1. If It haJ been placed between other 
ItemBt those other itede would have moved apart to make x*ooa!. 

He can then examine the aseembly list. If eomethinc’ Is 
In the wrens' place, he can move It around with the polnfetln» 
device, until it la ready. 


He ed^ee nearer. 

He puts hi a hand on her 
She looks at him, asks: 
'’Aha I** he replies 
She does a double take. 


Editor points at 
bottom line. 

It bllnka. 

Editor points 

between ssecond and 
third lines. 

Text can either 
Jump, or move 
through other text. 
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The choice of shot titles can be quite free, and very 
versatile eervlces can be deal^ned around them. (Of course, 
many » lasuea of taste are Involved. Some editors may want 
to work with numbers. This la permitted too.) 

Let us consider some flexible aspects of this title-manipulation 
system. 

The titles of shots can have details that ere useful or 
d 1st Ino'jrulsh between them: 

SHE STEPS TOWARD (HAIR STRBAi-.lNO) 


They can contain Information on photography: 
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TH£Y FACE EACH OTHEK (PAN SHOT) 

THEY FACE EACH OTHER (TWO SHOT CU) 

However, you aay not neceesarlly want all that Inforniatlon on 
the screen when complllnff assembly lists. The ecJltor may want 
to manipulate short titles on the screen but have more * 
written details available. Suppose a shot had the foll^owlncr 
full title: 

THEY WALK. HE LOOKS HAPPY; SHE LAGS A LITTLE, 

When desired, the editor could have this reduced; for eratuple, to: 
THEY WALK. * 


or 


They walk. * she lags * 

XXKXXXXKKX 

(The asterisk reminds the editor that he has more details In the 
title If he wants to see them.) At different stai^eB ofti the 
edltlnff procesi, different phrases of the shot descrlpt*lons can 
be Included In the screen caption. 

An alternative method Is simply to cut off the shot 
description at the end of the first line. Obviously the editor 
may have his choice of bow to shorten the shot descriptions. 
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Shot Jeecrlptlone can overlap In varlcue ways. For example, 
ell the aifferent ahote of the eame event may have a common 
description, with quallfylnor phrases or codes alono^sWe. If 
an actual scrlr-t Is Included In the system, the tle-ln of that 
script will also Involve considerable overlap amonv shots. 

Not only Individual shots, but assemblies of shots, can be 
crlven names, and be transferred to tapes automatically by the 
user's placln" these names on an assembly list. Such conerlom- 
erate names mlo-ht for convenience end In "scone," "sequence* 
and "number," e.»., "Love Scene," "Chase Sequence," "Chorus 

Number.") 

It will therefore be possible to create the whole work 
from finished scenes by simply lletln«r the scene names and 
B-lvlno- other Instructions that command a final copy to be made. 

For Instance, a commercial can be ordtered Into existence ^ 

simply by namlncr Its »r parts (which have already been finished 

separately) '• 

B£ACH T£IASLH 
BOTTLL POJRINCJ 
3FLA8U KLNTAGE 
DANCIUO 

BCi'lLJB/OIIlL KVNTAQS; 

SUNSET, WITH PRODUCT 

Just because a shot or sequence has been described and 
listed does not mean the editor has to use It. The editor may 
list for assembly all the shots In a «rlveo cstewory, or all 
the out-takes In a trlven scene, he may also create different 
assembly lists for the same scene, elvln't them slightly 
different titles. In order to examine possible varla^tlons. 

^ n > . ||| T ill iii men'l^ ... lu iuouwst 
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< ■ ( ■ Hb tii ii w iTffr; cr»B-nr^igj = erinT~ Ii-rt»-r 

t hat f ne ti ff i i iP, t/tunHJ f hwni HllglTtty VrPliUTtnt i 1 M gBlS. 

-Vi ii t i^T t e r g H HUil i iH .um i l u l ImiA. 

It Will also be poealble for the e^^ltor to request out-takes, 
leftovers and other collections of shots without assembly lists, 
as lonff SB an erect defloitlon of the shots he wants can be 
framed In terms of their catef'orles or assembly status. 

The editor may also request shots that have a certain 
connection to the script list, or particular connection codes. 

r in ' <1 di l l l e i ii i i PnHiii 

vy f nanm i. (Hut twe e d 4 tor mny bIpC" 

il B nil'll li nin ' ..ant inn tn t hn nrr i r ^ 

^r- p opt l c ul 'jr r fthn fin t 

One shot can be divided up different ways, and the reBultln<T 
clips can be t^iven different names. (But the editor will always 
be able to check onirk whether he Is uslne^ the shot elsewhere.) 

It will be possible for the editor to Inquire of the system 
whether he has repeated any shots, or parts of shots. In a ^Iven 
assembly. Other related types of question will be possible: 
for Instance, "Have I chen<^ed the orlo-lnal « sequence of any 
of these shots?" 

When there Is a fired script In the system. It can be used 
to provide a quick written summary of the cuttlno’. The editor 
would **» ask the computer to display the shot descriptions In a 
specific assembly next to a script: 











































SCRIPT 


SHOT DESCRIPTIC.VS 

IN PARTICULAR ASSE^iBLY 



\ 


Perspective niiyrt 
vfxiasvvx 
shot of noee. 
Pan to the 
waltlner arunu<an. 


RANDY 
Gee , a nose 


Two shot of 

RANDY i UNCLS; BILL 


UNCLE BILL 
Don't be too sure 
son. 


/ 


Of course, the script correspondence would have to be 
loerred Into the system, In a manner similar to the handlln*^ 
of catecrorles; (unless It could be done In advance according 
to some sort of production mana^'er's record). But once the 
orltrlnal shots had all been lo^sad ajralnst the script. In 
sufficient detail, the system could automatically match the 
shot deacrlptIons for an assembly to the script. 


The use of text on the screen la not the only possible 
method for Iceeplnc)* track of shot Information, althouiyh it Is 
perhaps the mast versatile. 

Another possible schea<e would put selected frames from 
specific shots into some device an which they could later 
be reviewed quickly— either a VTR or a video disk. The editor 
could see them Immediately to refresh hie memory without seelntr 
whole shots. (They could be overlaid with symbols and arrows 
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to loricate CDOtlonSf an<3 with coiiuneotSt etc.) 

It would also be poeelble for the editor to dictate hie 
comaents directly Into the systeai. They would be atored 
on soire addreesable tape device, poeeltley a VTR, and be heard 
alon^ with, or before, the shots durln-r wolch t ne dictation 
occurred. 

Unfortunately, this would not lend Itaelf to painless 
re-aequencloo- the way tK» that the written text In the ooaiputer 
does. However, It ml<Tbt be a »ood method for h8ndlln»T a 
lot of minor coaimeota worth revlewlnnr. 

Line drawing’s can be Included, and allow the editor 
to store, an>d auperlmpoae, rout'h anloiatlona of the compoalt lone 
ha wants to try, In sequence. This aketchln^ facility would 
come "free" with certain machlnee, auch aa the DEC 338, but 
considerably Increase the trouble of p; o«rrammlner the system 
on others, such as the LINC-8.) 




OATsmasiNC 


AO 


When he t^pes In the shot descriptions, the editor 
Cut>y also choose to put the shots In cate-'ories* The catef'oriee 
ore to be of hla own J»t select Ion, of course. Shots can be 
Indexed on BJany eatep-orles, » Inoludlnf^ quality. For Instance: 


Subject 

Hero 

Heroine 

Villain 

etc. 

Quality of composition 

I4s(rnlf Icent 

lood 

Fair 

Acceptable 

Louey 


i^vement type 


hoveu.ent spedd 


Still 

Camera moveoient 
Subject movement 
Background movement 


Slow 
i>ied luffi 
Fast 


Aasln-nlnp- ehota to these catei'orles requires no tricky 
abbreviations or codln«T forme. After each shot the list can 
roll by on the screen, and the editor can simply point at the 
attributes It h?B. For simpler attributes,such as who Is In 
the shot, these msttars could be decided by an Bss-t 
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SlhULTANEOUS CATEGORY DISPLAYS 


_1 

Beautiful 


Hero4— 

Ooodf^— 


He ro 1 ne 

Fa ir 


Villain 

Poor 



Scrap 



EDITOR'S aONITOR 

fisSISTANT'S aONITOR 


To save time In some applications, the cate^^ory Hats coul-l be 
surerIm':oBe<l on the pasaln*^ picture. 

The editor may ask, then, to see all shots hsvlo<r any 
of hla oate^'orlzed properties, or any combInat Ion of these 
properties. (It Is wise, however, to be'-ln by asklno' the 
system how many there are havlnc^ this combination. Bed truesaes 
can waste tIme.} 


4 
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LAP CONTROL 

One of the problemp In film edltlner, and prx presumably 
video editing as well, Is decldlncr where to metre a cut between 
consecutive shots. Actually this Is two decisions: where to end 
the first shot, and where to beo-ln the second. (Exception: 
where they are synchronized to a common sound traclr or timed 

to some common event-- let us call them 
"synched” shots— then there Is only one decision to make. 

But where the exact tlmlOT Is optional, then there are two 
decisions.) 

Let us call this the problem of "lap control." The system 
under dlecusslon can offer services to ease the editor's task 
when decision Is difficult. 

The following dlacrram sufl^iyests terms which Jii will help 
discuss the Issue. 
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"lap pair" 


FIRST SHOT 


f, $• '-'i" 

last cut t Ins^-point 

possible 

out tiny-point S 


first possible cuttIniy-polnt 


SECO ND SHOT 





tape motion 


In the system under dlscusalon, the editor speclifles to 
the system through pushbuttons that two particular shots are 
consecutive, he then views the shots, and specifies the cuttlnpr- 
polnts he would like to try, or the ranyes within which he thinks 


























^3 


he wouW like to cut. He may, lo aidltlon, type In or dictate 

remarka on the different cute. 

After a pause, the syetem la ready to show him the several 

lap i altern*atIves lo quick succeaelon. Before each lap pair, 
hie cotnmente on that alternative are displayed on the screen 
or played through a speaker. The closlosr part of the 
first shot Is shown, and then the first cut he has requested 
la seen. The system Is Immedlataly ready to show the »wxy 
next lap pair, then the oe^t, and so on. (It should be pointed 
out that the editor cannot usually ask to see "all combinations 
of the cuttlnt- points In the leading and trailing shots, since 
the number of shots may <^row astronomically. If the editor 
Is considering five cutt Ino-polnt s on the leading shots and 
five on the tralllne', there are twenty-five possibilities.) 

To make sllf^ht adjustments In the cutt In*?—point s, special 
adjustment thumbwhpels or 

other custom controls can be provided. The lap pair would 
then be seen a'^aln. 

Another possibility would be a video display such as 
the followlnf»: 


"LAP fJkP" 


SECOND shot: ^ 

TURN AND DRAW 


FIRSjl SHOT: 

HAND ON HOLSTER 



Au 
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This l8 a aap ahowlno' alT different cuttIno—polnta, and 
four alternative poaalble “epllcea*’ between them. The editor 
hae written comments on two of them. He may look at the four 
alternatives In quick succession, then modify any or all of 
the alternatives by calllnor this map back to the screen and 
performing' operations upon It with the special controls. 

(For Instance, he may slide a cutt In'^-point on the map and 
the cut will be chan^^ed accordlo'^ly.) 

A similar technique would help select a cuttln‘r-polnt 
within a lap ran'^e. Suppose the editor hae chosen a lap ran^e 



The two shots can be shown surerlmrosed for the duration of 
the lap rancre, or a dissolve can take place, beTlnnlno- at 
the start of the lap ran»e and ending at the end of the 
lap ran'^e. The editor may make a quick adjustment on the 
lap map, and Immediately see the resulting cut. 

I should point out that to make such an adjustment* 
on the lap map should take no more than ten seconds. 


The reader may doubt the immediacy of successive replays 
in the above description. For this reason, let us examine 
In detail a possible way of handlln^v the lap-control video. 











Let UB asBume that the orl-rlnal 1 b on VTR #1, and there 
are four other VTRs, 2 throu<rh 5* The editor epeclfles two shots 
which are to be consecutive* 8hot A and Shot B« 

VTR 1 Is moved to the bec^lnnln» of H Shot A. 

VTRs 2 to 5 are moved to free stretches of tape* or ® areas 

which may be overwritten. 

Shot A (In Its loncrest version) Is copied simultaneously 

from VTR 1 to all the others. 

VTR 1 Is now moved to the start of Shot B. 

Shot B (In Its lon^'est version) Is copied slmultaoeously 

from VTR 1 to all the • others. 

VTR 2 and 3 bacfeapace to the be<^lonlnc' of Shot A. 

Shtts A and B are now copied consecutively from 2 and 3 

to 4 and 5. 

VTR 4 and 5 now baciepace over all four shots theyli have 
copied. 

All four shots are now transferred from 4 and 5 to 2 and 3. 
The lineup Is now; 


VTR 2 
VTR 3 
VTR 4 
VTR 5 


A 

B 

A 

B 

A 

B 

A 

B 

A 

B 

A 

B 

A 

B 

A 

B 







r ' ^ i/ ' 

^ \^f 'PI 

A 

SB 

A 

B 




We Ic now have more than enouorh shot pairs for a new pair 
always to be ready. (Other arrano-ements may be preferable.) 
It Is now a relatively simple matter to show lap pairs 
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con86Cutlv 0 ly with 31ff6reot tlnjlno^Si b8Ciclno^ up VTR8 IndlvUuslly 
88 neeaed. The computer Bwltchee between VTRe 8t epeclflc 
cutt lncr-polnt8 88 required. 
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FUTURE SERVICES 


The services that have been aescrlbeiJ are Intended to be a 
be'^lnnln-T, (rood enouirh to start 00 , and In fact worth at8rtln<T, 
which Is Important. 

But this Is Just the be»lonln<r. Many more services are 
possible! some oil'rht be excellent. 

Yet the deslJOffn of these services Is a difficult matter. 

On the one hand, computers cannot do everythln^r, and it Is very 
easy to ask too much. On the other band, judicious and artistic 
choice Is the human prerof'atlve, and It Is easy and sometimes 
tempt Intr to erlve It up to the computer, which Is certainly a 
mistake. 

In any case, let us consider a few more services which 
may lie somewhere between the Impossible and the undesirable. 
These constitute speculation and are not pert of this proposal. 

One way this system can be extended Is to handle more 
complex relational notations than have been described. Complex 
services could be built around these relations. Such relations 
ml»ht include ''This shot could bo used In several different 
places, but only if..." and "This part of the shot Is unusable, 
but the parts around It are orood." 

Another second-generation service would be what we may call 
Partial Specification. This Is a fairly complex application, 
which needs explaInlnt*-. 

It would be handy to the computer proo-rammer If an editor 
could always specify the exact sequence of shots that he wanted. 
However, subtle r« methods may be possible thpt exactly represent 
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the vflo-ue cholcee ent3 relatione that * really exist In his mlnfl. 
For Instance, the editor nilHit specify relations that existed 
between two shots, such as "this conies somewhere before this" 
and "If I use this I can't use that." We may call this procedure, 
buildint^ up vaf^uely from relations between pairs end small bunches 
of shots, partlal specifIcatlon » 

By speclfylncr such relationships one at a time, the editor 
can P-radually build a file tof «ruldlncr Information In computer 

stora-e, worlcln" his way toward the eventual exact sequence. 

The system could ^ - i 

XKXXXH yminrw tell him at any time whether the set of relation¬ 
ships ha has specified yet determine an exact sequence, or 
whether any of them are contradictory. If they are contradictory 
he may take some of them back, or sort them Into d1fferent aet g 
of relationship premises. 

Other services would permit the user deep oro^anlzatIon 
of his thou'^hts In visible form. It should eventually be 
possible to allow the user to consider complex alternatives, 
lo<r them and intercompare them In detail. A system of this 
kind was discussed In my paper "A File Structure for the Complex, 
the Chanerln*’’ and the Indeterminate.' 

If no aystem lltce these exists today. It Is because 
subtle creative applications of this type have so far been 
avoided by aystems analysts, and not because there Is anythin^ 
inherently Impractical about It. However, this aspect of such 
a system would be comparatively experimental. It will take a 
lot of work to devise functions like these that please the user 
but are logically analyzable by the machine. Such elds are for 
the next o-eneratlon of systems, the son of this one. 











